fty. 0 ) 



_____ Europaisches Paten tarn t 
European Patent Office 
_______ Office europeen des brevets 




@ Publication number: 0 676 889 A2 



EUROPEAN PATENT APPLICATION 



(ST) Application number: 95302136.7 
(g) Date of filing : 30.03.95 



© int. a. 6 : H04N 1/04, H04N 1/387, 
H04N 1/203 



<§) Priority : 04.04.94 JP 89171/94 

© Date of publication of application : 
11.10.95 Bulletin 95/41 

(S3) Designated Contracting States : 
DE FR GB 

(n) Applicant : CANON KABUSHIKl KAISHA 
30-2, 3-chome p Shimomaruko, 
Ohta-ku 
Tokyo (JP) 



(g) Inventor : Hasuo, Kamon, Canon K.K. 
30-2, 3-chome, 
Shimomaruko, 
Ohta-ku 
Tokyo (JP) 

Inventor : Nakamura, Takeshi, Canon K.K. 

30-2, 3-chome, 

Shimomaruko, 

Ohta-ku 

Tokyo (JP) 

(74) Representative : Beresford, Keith Denis Lewis 
et al 

BERESFORD & Co. 
2-5 Warwick Court 
High Hoi born 
London WC1R 5DJ (GB) 



(54) Image processing method and apparatus. 



O 
00 
00 

CD 
CD 



Q. 
LU 



@ A iarge-size (A3-size) original is foJded into 
two small-size (A4-size) portions. Images on the 
surfaces of respective portions are read by 
image reading units 111a and 111b. Image data 
output from the image reading units 111a and 
111b are stored in a memory 39. A detection unit 
120 detects end positions of the read images, 
and skew of each of the images is corrected. An 
image synthesis unit 36 synthesizes the image 
data of the respective surfaces based on the 
output of the detection unit 120 to provide the 
original single image. Thus, it is possible to read 
even a large-size original. 
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BACKGROUND OF THE INVENTION 

Field of the Invention 

This invention relates to an image processing 
method and apparatus in which Images of an original 
are read and synthesized. 

Description of the Related Art 

As disclosed, for example, in Japanese Patent 
Laid-open Application (Kokai) No. 5-145742 (1993), 
in order to synthesize images of an original whose 
size is greater than the maximum size readable by a 
scanner, image synthesis apparatuses have been 
proposed in which an image of an original is divided 
into a plurality of images, the divided images are read, 
the read images are synthesized again into a single 
image, and the synthesized image is output 

In the above-described conventional approach, 
however, when reading an image of an original while 
diving the image, the operator must perform parallel 
movement of the original, thereby causing a difficulty 
in performing such an operation that synthesized por- 
tions of the synthesized image do not shift with each 
other, and therefore insufficient quality of the synthe- 
sized image. 

In addition, a much longer time is required for 
reading an original than in an ordinary reading oper- 
ation. 

U.S. patent application Serial No. 846585 
(CFG660US) also describes a method in which an im- 
age of an original whose size is greater than the max- 
imum size readable by a scanner is divided into a plur- 
ality of areas, the divided areas are sequentially read, 
the contents of end portions of each of the read im- 
ages are recognized, and the read images are syn- 
thesized so that end portions of adjacent images do 
not overlap with each other. 

Even in such an approach, however, an operation 
of reading an original must be repeated, thereby re- 
sulting in inferior operabiiity. 

SUMMARY OF THE INVENTION 

It is an object of the present invention to provide 
an image processing method and apparatus in which 
the above-described problems are overcome. 

It is another object of the present invention to pro- 
vide an image processing method and apparatus in 
which images of a large-size original can be efficient- 
ly read and synthesized. 

It is still another object of the present invention to 
provide an image processing method and apparatus 
in which utilizing a reading device capable of simul- 
taneously reading images on both surfaces of a 
sheet, images on an original which has been folded 
Into two portions can be read and synthesized. 



It is yet another object of the present invention to 
provide an image processing method and apparatus 
in which images at edges of an original which has 
been folded into two portions are corrected, so that a 

5 high-quality image can be obtained. 

According to one aspect, the present invention, 
which achieves these objectives, relates to an image 
synthesis apparatus comprising first reading means 
for reading an image on the surface of an original, 

10 second reading means for reading an image on the 
back of the original, setting means for setting a mode 
of reading images on a folded original, connection 
means for connecting an image on a first surface of 
the folded original read by the first reading means and 

15 an image on a second surface of the folded original 
read by the second reading means to each other as 
a single image when the mode has been set by the 
setting means, and processing means for processing 
the image connected by the connection means when 

20 the mode has been set by the setting means. 

According to another aspect, the present inven- 
tion relates to an image processing apparatus com- 
prising first reading means for reading an image on 
the surface of an original, second reading means for 

25 reading an image on the back of the original, assign- 
ing means for assigning one of a first reading mode 
of reading an image on one surface of a small-size 
original, a second reading mode of reading images on 
both surfaces of the small-size original, and a third 

30 reading mode of reading an image on one surface of 
a larze-size original, and processing means for proc- 
essing an image signal output from the first reading 
means when the first reading mode has been as- 
signed, and for processing an image signal output 

35 from the first reading means and an image signal out- 
put from the second reading means when the second 
reading mode or the third reading mode has been as- 
signed. 

According to still another aspect, the present in- 

40 vent ton relates to an image synthesis method using 
an image reading apparatus comprising first reading 
means for reading an image on the surface of an orig- 
inal and second reading means for reading an image 
on the back of the original, comprising the steps of 

45 setting a mode of reading images on a folded original, 
reading an image on a first surface of the folded orig- 
inal by the first reading means and reading an image 
on a second surface of the folded original by the sec- 
ond reading means, connecting the image on the first 

so surface read by the first reading means and the im- 
age on the second surface read by the second read- 
ing means to each other as a single image, and proc- 
essing the connected image. 

According to yet another aspect, the present in- 

55 vention relates to an image synthesis method using 
an image reading apparatus comprising first reading 
means for reading an image on the surface of an orig- 
inal and second reading means for reading an image 
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on the back of the original, comprising the steps of 
setting one of a first reading mode of reading an im- 
age on one surface of a small-size original, a second 
mode reading mode of reading images on both sur- 
faces of the small -size original, and a third reading s 
mode of reading an image on one surface of a large- 
size original, and processing an image signal output 
from the first reading means when the first reading 
mode has been set, and processing an image signal 
output from the first reading means and an image sig- 10 
nal output from the second reading means when the 
second reading mode or the third reading mode has 
been set 

The foregoing and other objects, advantages and 
features of the present invention will become more 15 
apparentfrom the following detailed description of the 
preferred embodiments taken in conjunction with the 
accompanying drawings. 



BRIEF DESCRIPTION OF THE DRAWINGS 



20 



FIG. 1 is a diagram illustrating the configuration 
of circuitry of an image filing apparatus accord- 
ing to a first embodiment of the present invention; 
FIG. 2 is a cross-sectional view illustrating the in- 25 
ternal structure of the image filing apparatus of 
the first embodiment; 

FIG. 3 is a perspective view illustrating an exter- 
nal appearance of the image filing apparatus of 
the first embodiment; 30 
FIG. 4 Is a diagram illustrating a state in which a 
large-size original is folded; 
FIG. 5 is a diagram illustrating a state of read im- 
age data of the folded original; 
FIG. 6 is a flowchart illustrating an outline of im- 35 
age synthesis processing; 
FIG. 7 is a flowchart illustrating procedures of 
measuring an amount of skew of an image; 
FIG. 8 is a flowchart illustrating procedures of 
correcting skew of an image; 40 
FIG. 9 Is a flowchart illustrating procedures of de- 
tecting an end position of an image; 
FIG. 10 is a flowchart illustrating procedures of 
reconstructing an image; 

FIG. 11 is a flowchart illustrating procedures of 45 
reconstructing an image according to a second 
embodiment of the present invention; 
FIG. 12 is a diagram illustrating a display picture 
surface of a liquid-crystal display when an image 
index has been read; 50 
FIG. 1 3 is a diagram illustrating a picture surface 
of the liquid-crystal display for selecting an image 
index; 

FIG. 14 is a diagram illustrating an image-index 
data file; 55 
FIG. 15 is a diagram illustrating a document con- 
trol file; 

FIG. 16 is a diagram illustrating a page control 



file; 

FIG. 17 is a diagram illustrating a node table; 
FIG. 18 is a diagram illustrating storage regions 
of a magnetooptical disk; 

FIG. 19 is a diagram illustrating a logical address 
table; 

FIG. 20 is a diagram illustrating a FAT (file allo- 
cation table); 

FIG. 21 is a block diagram illustrating the config- 
uration of circuitry of an image filing apparatus 
according to the second embodiment; 
FIG. 22 is a cross-sectional view illustrating the 
internal structure of the image filing apparatus of 
the second embodiment; 

FIG. 23 is a flowchart illustrating an operation of 
reading images; 

FIG. 24 is a diagram illustrating a state in which 
a large-size original is cut and divided; 
FIG. 25 is a diagram illustrating a state of read im- 
age data; 

FIG. 26 is a diagram illustrating a state in which 
a large-size original is folded; 
FIGs. 27 and 26 are diagrams illustrating a meth- 
od of measuring an amount of skew of an image; 
FIGS. 29 and 30 are diagrams illustrating a meth- 
od of correcting skew of an image; 
FIG. 31 is a diagram illustrating detection of an 
end position of an original; 
FIGS. 32(A) through 32(D) are diagrams illustrat- 
ing a method of removing black points and black 
lines produced during image synthesis; and 
FIG. 33 is a diagram illustrating an image moving 
method. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

FIG. 1 is a block diagram illustrating the config- 
uration of circuitry of an image filing apparatus ac- 
cording to a first embodiment of the present inven- 
tion. 

This image filing apparatus includes a CPU (cen- 
tral processing unit) 10 for controlling the entire ap- 
paratus, a ROM (read-only memory) 1 1 for storing op- 
eration programs for the CP U 1 0, a RAM (random ac- 
cess memory) 12 used, for example, as working 
areas for the CPU 10, loading areas for data and pro- 
grams from a magnetooptical-disk storage device 
115, and a communication interface circuit 17 for 
communicating image data with a communication ap- 
paratus 38 via a communication network 37. 

The image filing apparatus also includes a key- 
board 7, a keyboard interface circuit 16 for connecting 
the keyboard 7 to a system bus 30, a time measuring 
unit 15 connected to the system bus 30, a magne- 
tooptical-disk-storage-device interface circuit 27 for 
connecting magnetooptical-disk storage dhvices 115 
and 115b to the system bus 30, and a data flow con- 
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troller 50 for controlling the flow of data between a liq- 
uid-crystal display 32, an LBP (laser-beam printer) 
31, a text RAM 14, a graphic RAM 13, the system bus 
30 and the like. 

The image filing apparatus further includes a 
driving-system interface circuit 16 for connecting a 
driving system 1 9 for an image reading device to the 
system bus 30, a channel-A CCD (charge-coupled 
device) 111a for reading one surface of an original, a 
channel-B CCD 1 11 b for reading the other surface of 
the original, amplifiers 20a and 20b for amplifying the 
outputs of the CCD's 111a and 111b, respectively, a 
synthesis unit 36 for synthesizing an image signal on 
channel A and an image signal on channel B, an A/D 
conversion unit 21 for converting an image signal out- 
put from the synthesis unit 36, which has synthesized 
signals from the CCD's 111a and 111b, into a digital 
signal, an image processing unit 22 for adjusting the 
density and contrast of an image, a binary-coding cir- 
cuit 23 for converting an output signal from the image 
processing unit 22 into binary image data, and an im- 
age synthesis memory 39 for storing the binary-cod- 
ed image data and performing image synthesis. 

The image filing apparatus further includes func- 
tion keys 34 for instructing various kinds of process 
functions of the apparatus, a compression unit 24 for 
compressing the image data stored in the image syn- 
thesis memory 39, an expansion unit 25 for expand- 
ing the compressed image data, compressed-data 
buffers 33a and 33b for storing the compressed data, 
a disk interface circuit 27 for inputting data In and out- 
putting data from the magnetooptical-disk storage 
device 115, and a disk data flow controller 26 for con- 
trolling the flow of data between the compression unit 
24, the expansion unit 25, the compressed-data buf- 
fers 33a and 33b, and the disk interface circuit 27. 

FIG. 2 is a schematic cross-sectional view illus- 
trating the internal structure of the image filing appa- 
ratus of the first embodiment. FIG. 3 is a perspective 
view illustrating an external appearance of the image 
filing apparatus of the first embodiment. 

In FIGS. 2 and 3, originals 1 are mounted on an 
original mount 2 provided at a lower front portion of a 
case 6 of the apparatus, and are stacked and posi- 
tioned by regulation plates 3a and 3b shown in FIG. 
3. 

As shown in FIG. 3, a sheet-discharging portion 
4 for the original 1 is opened at an upper portion of the 
case 8, and a sheet-discharging tray 113 is provided. 
A screen 5 for displaying image information, opera- 
tion instructions and the like is provided at a front por- 
tion of the case 8, and a liquid-crystal display 32 
shown in FIG. 2 is provided inside the screen 5. 

An insertion port 6 for inserting a magnetooptical 
disk is provided at a side of the case 8. The apparatus 
also includes the keyboard 7 for inputting, for exam- 
ple, a key word for image retrieval. 

As shown in FIG. 2, the case 6 contains original- 



feeding rollers 102, 105a and 105b, fluorescent 
lamps 106a and 106b for illuminating an original, mir- 
rors 107a, 107b, 108a, 108b, 109a and 109b, lenses 
110a and 110b, sheet-discharging rollers 112a and 

5 112b, original-conveying belts 116a and 116b, an 
original sensor 120, original- backup members 114a 
and 114b, and the like. Motors, serving as driving 
sources for these rollers and belts, are not shown. 
The functions of these components will be described 

10 later. 

A description will now be provided of operations 
of the apparatus of the first embodiment in the se- 
quence of: (1 ) turning-on of a power supply, (2) stor- 
age of an image index, (3) selection of an image ln- 
15 dex, (4) reading of an image of an original, (5) synthe- 
sis of images, (6) storage of images, and (7) retrieval 
of an image. 

(1) Turning-on of a power supply 

20 

When the operator has turned on a power-supply 
switch (not shown), the CPU 1 0 first checks the RAM 
12, initializes internal parameters, initializes the re- 
spective interface circuits, and clears the liquid-crys- 
25 tal display 32 in accordance with a program stored in 
the ROM 1 1 . Then, operations of the function keys 34 
and the keyboard 7 by the operator are awaited. 

(2) Storage of an image index 

30 

Then, before reading an image of an original and 
storing the read image in the magnetooptical disk 35, 
an image index, serving as a keyword in image re- 
trieval, is stored in advance in the magnetooptical 

35 disk 35. The image index is not an index using code 
data, such as characters or the like, but is an index 
using image data. Adesired image can be used as the 
index. An operation of storing the image index is per- 
fomed in the same manner as in an ordinary operation 

40 of storing an image of an original. 

FIG. 12 is a front view illustrating a display pic- 
ture surface of the liquid-crystal display 32 when an 
image of a "component" has been read as an image 
index. 

45 Next, the operator assigns the position on the pic- 

ture surface where the image index is to be registered 
using the function keys 34. 

In FIG. 12, for example, the uppermost position 
on the leftmost column can be assigned by depress- 
so ing the leftmost function key (having the character 
"1 w ) one time, and the third position from above on the 
second column from the left can be assigned by de- 
pressing the second function key from the left (having 
the character °2") three times. 
55 By alternately repeating reading of an image for 

an index and assignment of the position where the im- 
age is to be registered, a plurality of image indices 
can be registered. 
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When the image indices have been registered in 
such a manner, the image-index data file shown in 
FIG. 14 is generated and stord in the mag netoopt leal 
disk 35. 

(3) Selection of an Image Index 

Before reading an image of an original, the im- 
age-index-selection screen shown in FIG. 13 is dis- 
played. The operator selects an image index relating 
to the original to be stored using the function keys 34. 

For example, when the operator intends to store 
the drawing of a component, image indexes a and e 
may be selected. 

As shown in FIG. 14, by selecting the image in- 
dices "a" and "e", an image-index pattern having Vs 
at bit positions corresponding to the selected image 
indexes is generated. 

Instead of image indexes, or together with image 
indexes, the name or the number of the document to 
be stored may be Input to columns g and h shown in 
FIG. 13 through the keyboard 7. 

The index data set in the above-described man- 
ner is held in a predetermined region of the RAM 12 
until the image is stored in the following manner. 

(4) Reading of the image of the original 

Next, the operator performs an operation of read- 
ing the original. When the original has an ordinary 
size (for example, the A4 size), the operator mounts 
the original 1 on the original mount 2, as shown in FIG. 
3, and instructs an ordinary reading operation 
through the function keys 34. The operator also in- 
structs whether the image on one surface of the orig- 
inal must be read or the images on both surfaces of 
the original must be read through the function keys 
34. The CPU 10 controls the synthesis unit 36 based 
on this instruction, and selects whether image data 
from both of the CCD's 111a and 111b must be used 
or image data from one of the CCD's 111a and 111b 
must be used. 

When the original has a large size (for example, 
the A3 size) which cannot be mounted on the original 
mount 2 as it is, the operator folds the original into the 
A4 size, as shown in FIG. 4, mounts the folded origi- 
nal on the original mount 2, and instructs a large-size 
reading mode through the function keys 34. In this 
case, the synthesis unit 36 performs basically the 
same operation as in the case of reading both surfac- 
es of the original. 

In any of the above-described cases, when a 
reading operation has been instructed by the opera- 
tor, the CPU 10 controls the driving system 19 via the 
driving-system interface circuit 18 in accordance with 
a program stored in the ROM 11. 

The operation of the large-size reading mode will 
now be described. 



First, the feeding roller 102 is rotated in the direc- 
tion of the arrow shown in FIG. 2 by a motor (not 
shown) to feed the original 1. The original 1 is then fed 
to a reading position by the conveying rollers 105a 

5 and 105b. The images of the original itlumunated by 
the illuminating lamps 106a and 106b are reduced by 
the lenses 110a and 110b after passing through the 
mirrors 1 07a, 1 08b and 1 09a, and mirrors 1 07b, 1 08b 
and 109b, and are imaged onto and read by the 

10 CCD's 111a and 111b, respectively. 

Image signals representing the read images are 
amplified by the amplifiers 20a and 20b. The ampli- 
fied image signals are serially synthesized by the 
synthesis unit 36 for every main scanning operation 

15 of the CCD's 111a and 111b. The obtained synthe- 
sized signal is digitized by the A/D converter 21, is 
subjected to edge emphasis processing, density ad- 
justment and contrast adjustment by the image proc- 
essing unit 22. and is converted into a binary image 

20 signal by the binary-coding circuit 23. The converted 
signal is stored in the image synthesis memory 39. 

The synthesis unit 36 has the function of alter- 
nately passing data for one main scanning operation 
from the CCD 111a and data for one main scanning 

25 operation from the CCD 1 1 1 b to the following stage by 
switching incorporated switching devices. 

Accordingly, the image signal from the CCD 111a 
and the image signal from the CCD 111b are serially 
connected in units of a line. 

30 In order to prevent transmission of the image of 

the surface to the back and to detect edges of the 
original, the surfaces of the original-backup members 
114a and 114b have a particular color, such as black 
or the like, or are subjected to mirror finish, and read- 

35 ing positions of channel A and channel B are shifted 
by about 16 mm. 

The CCD's 111a and 111b are controlled so as to 
perform a reading operation for a period longer than 
the length of the original detected by the original sen- 

40 sor120. 

Accordingly, as shown in FIG. 5, the read images 
of the original stored in the image synthesis memory 
39 are in a state in which each of the right and left im- 
ages is surrounded by a black frame, and the images 

45 are shifted with each other in the vertical direction. In 
the image synthesis memory 39, a bit "1" corre- 
sponds to black and a bit "0" corresponds to white. 

The original whose images have been read is 
conveyed by the conveying belts 116a and 116b, and 

so is discharged onto the sheet-discharging tray 113 by 
the sheet-discharging rollers 112a and 112b. 

When an ordinary operation of reading both sur- 
faces has been instructed, the following synthesis of 
images is not performed, but read images are stored. 

55 

(5) Synthesis of images 

FIGS. 6 through 10 are flowcharts illustrating 
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procedures of image synthesis in the first embodi- 
ment The image synthesis processing is performed 
by the control of the CPU 10 based on a program stor- 
ed in the ROM 11. 

First, an outline of the image synthesis will be de- 
scribed with reference to FIG. 6. 

First, in order to synthesize right and left Images 
stored in the image synthesis memory 39, a reference 
position for synthesizing the images to the center is 
set, as shown in FIG. 5 (step SO). 

Next, the amount of skew of each of the read im- 
ages is measured by a method which will be descri- 
bed later (step S1). If the measured amount of the 
skew is within the range "a" shown in FIG. 28 (for ex- 
ample, between - 0.2 degrees and + 0.2 degrees) in 
step S2, the process proceeds to step S4 without cor- 
recting the skew. If the amount of the skew is outside 
the range "a", the process proceeds to step S3. 

If the measured amount of the skew exceeds the 
range b shown in FIG. 28 (for example, between - 5 
degrees and + 5 degrees), the operator may be noti- 
fied of the abnormality. 

When the amount of the skew is equal to or great- 
er than a predetermined value, the skew of the right 
and left images is corrected in step S3, and the proc- 
ess then proceeds to step S4. 

In step S4, in order to synthesize the images, an 
end position of the original is detected. In step S5, the 
image is reconstructed based on the result of the de- 
tection in step S4. 

Next, a description will be provided of procedures 
of measuring the amount of the skew of the image 
performed in the above-described step S1 with refer- 
ence to FIG. 7. 

First, the distance from the reference position to 
a position where the pixel changes from black to white 
and white pixels continue for a predetermined number 
of bits is searched for each horizontal line in images 
stored in the image synthesis memory 39. The first 
position where the distance for each line is deter- 
mined (i.e., the position where white pixels continue 
for the predetermined number of bits) is determined 
to be an upper end, and the last position where the 
distance for each line is determined (i.e., the position 
where black pixels continue for the predetermined 
number of bits) is determined to be a lower line (step 
S11). 

The positions where black pixels and white pixels 
continue for the predetermined number of bits are de- 
termined to be the upper end and the lower end, re- 
spectively, in order to prevent an erroneous point, 
such as a point "a" shown in FIG. 27, of the original 
from being determined to be an upper end or a lower 
end when the original moves in an oblique direction 
while it is read. 

As shown in FIG. 27, the amount of skew (inclin- 
ation) of the image of the original is obtained from the 
x-y positions of the upper end and the lower end (i.e.. 
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from the number of dots from the reference position 
and the number of lines from the upper end of the 
memory for each of the upper end and the lower end) 
(stepS12). 

s Next, a description will be provided of procedures 

of correcting skew of the Image shown in the above- 
described step S3 with reference to FIG. 8. 

First, the direction of the inclination is obtained 
from the upper end and the lower end obtained in the 

10 above-described step S11 (step S31). In the case of 
inclination toward the upper right as a result of deter- 
mination in step S32, the step proceeds to step S33. 
in the case of inclination toward the upper left, the 
process proceeds to step S35. 

15 In step S33, as shown in FIG. 29, the x direction 

is divided as indicated by 0, © and (§) based on the 
number of dots corresponding to the value of the in- 
clination by making the lower end A as a reference 
position (the average number of dots necessary for 

20 shifting by one line), and the image is sequentially 
moved upward in units of the division up to the posi- 
tion of the lower end A (step S33). 

Then, as shown in FIG. 30, the y direction is div- 
ided as indicated by®, © and ® based on the num- 

25 bar of lines corresponding to the value of the inclina- 
tion by making the lower end B as a reference position 
(the average number of lines necessary for shifting 
by one dot), and the image is sequentially moved 
rightward up to the position of the lower end in units 

30 of the division (step S34). 

In steps S35 and S36, the same Image moving 
operation as that performed in the above-described 
steps S33 and S34 is performed by making the upper 
end as a reference position. 

35 Although in the present embodiment the image 

moving operation is performed by making the lower 
end as a reference position in the case of inclination 
toward the upper right, and the image moving opera- 
tion is performed by making the upper end as a ref- 

40 erence position in the case of inclination toward the 
upper left, the image moving operation may be per- 
formed by making the upper end as a reference pos- 
ition in the case of inclination toward the upper right, 
and the image moving operation may be performed 

45 by making the lower end as a reference position in the 
case of inclination toward the upper left 

Next, a description will be provided of procedures 
of detecting the end position of the original shown in 
the above-described step S4 with reference to FIG. 9. 

so First, as shown in FIG. 31, respective edge data 

are compared with each other by making edge data 
of the upper end as a reference data and by making 
edge data of the next line as a comparative data (step 
S41). 

55 The edge data is represented by the distance to 

the first white pixel which can be estimated to be a 
part of the image as a result of search starting from 
the reference position. In general, the edge data is the 
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first white pixel, but in some cases, the edge data is 
not always the first white pixel when noise is included 
in the image data and a filter for removing noise is pro- 
vided. 

The reference data is edge data which can be s 
considered to correspond to the end position of the 
original. The comparative data is edge data to be 
compared with the reference data in order to deter- 
mine if the comparative data corresponds to the end 
position of the original. Edge data of respective lines 10 
sequentially become comparative data. 

Then, it is determined if comparison of edge data 
has been completed for all lines from the upper end 
to the lower end of the image (step S42). If the result 
of the determination is negative, the process pro- is 
ceeds to step S43, where it is determined if the com- 
parative data is within the permissive range for the 
amount of bending of the original as a result of com- 
parison with the reference data. 

The amount of bending of the original is the 20 
amount of bending of the end position of the original 
caused by fluctuation of the original in the direction 
of the optical axis while the original is conveyed. That 
is, the position of the edge of the original imaged onto 
the CCD shifts due to the deviation of the original in 25 
the direction of the optical axis. For example, when 
the distance between reference data and compara- 
tive data (the number of lines) equals between 1 and 
10, the permissive amount of the bending (the num- 
ber of dots) equals 1. Similarly, when the distance 30 
equals between 11 and 20, 21 and 50, and 51 and 
1 00, the permissive amount equals 2, 3 and 4, respec- 
tively. 

If the result of the determination in step S43 is af- 
firmative, the process proceeds to step S44, where 35 
comparison is performed by making the current com- 
parative data as a reference data and by making the 
next edge data as a comparative data. If the result of 
the determination in step S43 is negative, the process 
proceeds to step S45, where comparison is per- 40 
formed by making edge data of the line next to the 
compared line as a comparative data without chang- 
ing the reference data. 

If the result of the determination in step S42 is af- 
firmative, for edge data of the line which has not be- 45 
come reference data, data obtained by combining 
edge data of adjacent lines which have become ref- 
erence data Is made new edge data representing a 
virtual edge. This virtual edge is made to be the end 
position of the original. so 

Although a description has been provided of the 
processing for the image at the left in FIG. 5, the same 
processing is performed for the image at the right 

Next, a description will be provided of procedures 
of reconstructing the image shown in the above- 55 
described step S5 with reference to FIG. 10. 

First, in step S51, as shown in (A) of FIG. 33, the 
images stored in the image synthesis memory 36 are 



moved to the reference position for respective lines 
based on the end position of the original obtained by 
the above-described detection of the end position of 
the original, and the image of the original is recon- 
structed. 

While moving the image, as shown in FIG. 32(A), 
projections and recesses are, in some cases, present 
at the end position (45a) of the original although char- 
acters and figures of the original are not distorted. 
This is caused by errors produced during a reading 
operation by the CCD. If image data is moved in this 
state based on the end position (45c) of the original, 
characters and figures which are originally not distort- 
ed distort, as indicated by 45d in FIG. 32(d). 

Accordingly, as for small projections and recess- 
es in image end data, processing of moving the image 
data based on the position closer to the reference 
position (at the side of projections) (smoothing proc- 
essing) is added. Thus, as shown in FIG. 32(B), the 
image can be reconstructed without producing distor- 
tion in characters and figures. 

When smoothing processing of the image has 
been performed, black points and black lines are gen- 
erated in a synthesized portion of the image. Hence, 
in step S52, the bits of the black points and the black 
lines generated in the smoothing processing are in- 
verted. Thus, as shown in FIG. 32(C), image synthe- 
sis can be performed without producing distortion in 
characters and figures and without leaving black 
points and black lines in the synthesized portion of 
the Image. 

Thereafter, in step S53, the image at the right 
side is moved upward by a distance corresponding to 
the amount of deviation in the reading position be- 
tween channel A and channel B to adjust the heights 
of the images at the right and left sides. At that time, 
the amount of movement may be finely adjusted 
based on the con-elation between the right and left 
images. 

Then, in step S54, the region of the original of the 
synthesized image is extracted to provide image 
data. According to this processing, the amount of im- 
age data can be reduced. 

According to the above-described procedures, 
the reconstruction of the image of a folded large-size 
original is realized. In the above-described process- 
ing, necessary temporary data, data of the result of 
the processing, and the like are stored in predeter- 
mined regions of the RAM 12. 

(6) Recording of the image 

The read large-size image is compressed by the 
compression unit 24 using an image compression 
method, such as MH (modified Huffman), MR (modi- 
fied read), MMR (modified modified read) or the like, 
and is then stored in one of the compressed -data buf- 
fers 33a and 33b. The stored compressed image data 
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and the above-described index data for retrieve! are 
transmitted to the magnetooptical-disk storage de- 
vice 115 via the disk interface circuit 27. and are writ- 
ten in the magnetooptical disk 35. 

The index data for retrieval is recorded in the 
magnetooptical disk 35 so as to be correlated to the 
corresponding image or document. 

For example, in the above-described case of the 
component drawing", a record including the image-in- 
dex pattern "100010 the document name "com- 
ponent drawing", the document number a 150", and 
the like is generated in the second row of PIG. 15. 
The "page file pointer" indicates the number of the 
row of the page control file (shown in FIG. 16) to 
which the first page of the document file corresponds. 

Information relating to each page of a stored 
document is stored in the page control file shown in 
FIG. 16. The "page file pointer" at the right of the 
document control file shown in FIG. 15 indicates the 
record number of the page control file to which the 
first page of the stored document corresponds. 

The record relating to the page also stores infor- 
mation indicating whether the image has been read, 
for example, in a two-face mode, in a one-face mode, 
or in a large-size reading mode. 

In the present embodiment, the position on the 
magnetooptical disk 35 where image data, i.e., the 
above-described compressed image data, is record- 
ed is controlled by storing the node table shown in 
FIG. 17 in the magnetooptical disk 35. 

Each record of the node table includes a FAT (file 
allocation table) entry (62B0 for the above-described 
data) indicating the position of the FAT for the com- 
pressed-image file of the page, and the size (the 
number of bytes) of the compressed image data. The 
number of the record of the node table is termed a 
"node number", which Is stored for each page in the 
page control file shown in FIG. 16. 

The operation of storing the image of the original 
is completed by writting the compressed image data 
in the magnetooptical disk 35, and adding con-res- 
ponding records in the node table, the page control 
file and the document control file. 

(7) Retrieval of an image 

When the operator has assigned retrieval 
through the function keys 34, a picture substantially 
the same as that shown in FIG. 13 is displayed on the 
display 32, and the operator performs selection of an 
image index through the function keys 34, assign- 
ment of a document name and a document number 
through the keyboard 7, and the like. 

Then, the CPU 10 checks each record of the 
document control file, and selects a record which co- 
incides with the selected or input image-index pat- 
tern, and the document name or the document num- 
ber. 
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If the selected image index comprises, for exam- 
ple, only the image index a including the character 
and the image of the "component" shown in FIG. 13, 
since the image index e including the character and 
5 the image of the "drawing" is not selected, the image- 
index pattern differs from that shown in FIG. 14 such 
that the bit corresponding to the image index e equals 
0. 

However, when checking records of the docu- 

10 ment control file shown in FIG. 15, each record includ- 
ing an image-index pattern in which bit "1" is present 
at the same bit position where bit "1" is present in the 
image-index pattern input during the retrieval is se- 
lected. Hence, in the above-described case, the 

is "component catalog" in the first row, the "component 
drawing" in the second row, and the "component 
drawing" in the fourth row of FIG. 15 are selected. 

When a plurality of documents have been re- 
trieved as in the above-described case, the operator 

20 selects one of the documents using the keyboard 7. 

When one document has been finally selected, 
the record of the first page of the document is select- 
ed from the page control file shown in FIG. 16 by the 
page file pointer of that record. By speficying the 

25 node number, the FAT entry of the first page is ob- 
tained from the node table. 

By following the above-described FAT, a logical- 
address string is obtained. After specifying desired 
compressed image data in the magnetooptical disk 

30 35, the CPU 10 controls the disk interface 27 in order 
to read compressed Image data from the magne- 
tooptical-disk storage device 115. FIG. 18 is a dia- 
gram illustrating storage regions of the magnetoopti- 
cal disk 35. FIG. 19 is a diagram illustrating a logical- 

35 address table used in the present embodiment. Com- 
pressed image data is read from the corresponding 
storage region of the magnetooptical disk 35 using 
such a logical-address table. 

At that time, the CPU 10 also controls the disk 

40 controller 26 so as to transmit compressed image 
data from the disk interface 27 to the expansion unit 
25. The output data flow controller 50 is controlled by 
the CPU 10 so as to store image data from the expan- 
sion unit 25 in the graphic RAM 1 3 and to display the 

45 data on the display 32. 

Thus, compressed image data stored in the mag- 
netooptical disk 35 is read and displayed. 

Although in the above-described first embodi- 
ment image synthesis is performed while image data 

so is stored, image synthesis may not be performed 
while image data is stored, but may be performed in 
the graphic RAM 13 in the above-described manner 
when displaying the image data during retrieval. 
Although in the above-described first em bod i- 

5S ment the synthesized image is stored in the magne- 
tooptical disk 35, the synthesized image may be 
transmitted to the communication apparatus 38 via 
the communication Interface circuit 17 and the com- 
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munication network 37. 

As described above, according to the first em- 
bodiment, a large-size original can be read by utilizing 
the f unction of reading two faces, whereby a low-pri- 
ce and high-performance apparatus can be realized. 

Next, a description will be provided of a second 
embodiment of the present invention. 

FIG. 21 is a block diagram illustrating the config- 
uration of circuitry of an image filing apparatus ac- 
cording to the second embodiment. 

The configuration of the apparatus of the second 
embodiment differs from that of the first embodiment 
shown in FIG. 1 in that while the apparatus of the first 
embodiment includes the two CCD's 111a and 111b 
and the two amplifiers 20a and 20b, and the synthe- 
sis unit 36 for synthesizing image data from these 
units, the apparatus of the second embodiment in- 
cludes only a single CCD 111a and a single amplifier 
20a, and omits the synthesis unit 36. 

Since other components are the same as those 
of the first embodiment, the same reference numerals 
are provided for the same components, and a de- 
scription thereof will be omitted. 

FIG. 22 is a schematic cross-sectional view illus- 
trating the internal structure of the image filing appa- 
ratus of the second embodiment. 

As shown in FIG. 22, since the CCD 111b is omit- 
ted, the fluorescent lamp 106b for illuminating the 
original, the mirrors 107b, 108b and 109b, and the 
lens 110b are omitted. Since other components are 
the same as those of the first embodiment, the same 
reference numbers are provided, and a description 
thereof will be omitted. 

Next, a description will be provided of operation 
procedures in the second embodiment in the se- 
quence of (1) reading of an image of an original and 
(2) synthesis of the image. Since turning-on of a pow- 
er supply, storage of an image index, selection of an 
image index, storage of an image, and retrieval of an 
image are the same as in the case of the first embodi- 
ment, a description thereof will be omitted. 

(1) Reading of the image of the original 

When the original has an ordinary size (for exam- 
ple, the A4 size), the original 1 is mounted on the orig- 
inal mount 2, as shown in FIG. 3, and an ordinary 
reading operation is instructed through the function 
keys 34. 

When the original has a large size which cannot 
be mounted on the original mou nt 2 as it is, the orig Inal 
is folded, or the original is cut, as shown in FIG. 24, 
and is mounted on the original mount 2, and a large- 
size reading mode is instructed through the function 
keys 34. 

In any of the above-described cases, when a 
reading operation has been instructed, the CPU 10 
controls the driving system 19 via the driving-system 



interface circuit 1 8 in accordance with a program stor- 
ed in the ROM 11. 

The operation of the large-size reading mode will 
now be described. 

5 FIG. 23 is a flowchart illustrating the reading op- 

eration In the large-size reading mode. In this case, 
when instructing the large-size reading operation, the 
region of the original to be read (for example, the right 
side or the leftside) is also input through the function 

10 keys 34 (step S62). The input data is stored in a pre- 
determined region of the RAM 12. 

Then, the reading operation is executed (step 
S63). First, the feeding roller 102 is rotated in the di- 
rection of the arrow shown in FIG. 22 by a motor (not 

is shown) to feed the original 1 . The original 1 is then fed 
to a reading position by the conveying rollers 105a 
and 105b. The image of the original illumunated by 
the illuminating lamp 106a is reduced by the lens 
110a after passing through the mirrors 107a, 108b 

20 and 109a, and is imaged onto and read by the CCD 
111a. 

An image signal representing the read image is 
amplified by the amplifier 20a. The amplified image 
signal is digitized by the AID converter 21 , is subject- 

25 ed to edge emphasis processing, density adjustment 
and contrast adjustment by the image processing unit 
22, and is converted into a binary image signal by the 
binary-coding circuit 23. The converted signal is stor- 
ed in the image synthesis memory 39. 

30 At that time, the image data is stored in the image 

synthesis memory 39 so as to correspond to the read 
region of the original input through the f unction keys 
34. 

In order to prevent transmission of the image of 

35 the surface to the back and to detect edges of the 
original, the surfaces of the original-backup members 
114a and 114b provided in the conveying channel 
have a particular color, such as black or the like, or 
are subjected to mirror finish. 

40 The CCD 111a is controlled so as to perform a 

reading operation for a period longer than the length 
of the original detected by the original sensor 120. 

The read original is conveyed by the conveying 
belts 116a and 116b, and is discharged onto the 

45 sheet-discharging tray 113 by the sheet-discharging 
rollers 112a and 112b. 

The above-described operation is performed for 
each surface of the folded original, or for the left and 
right images of the cut original. That is, the reading 

so operation is performed twice. After reading the two 
images, the reading operation is terminated (step 
S61). 

Accordingly, as shown in FIG. 25, the read im- 
ages of the original are stored in the image synthesis 
55 memory 39 in a state in which each of the right and 
left images is surrounded by a blackf name. In the im- 
ages stored in the image synthesis memory 39, a bit 
"1° corresponds to black and a bit "0° corresponds to 
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white. 

Although in the foregoing description, the left and 
right images are assigned as the reading regions of 
the original, the left and right images may be read ac- 
cording to a preset sequence. In the case of a cut orig- 
inal, the left-side original and the right-side original 
may be continuously fed and read by a single reading 
instruction. 

(2) Synthesis of images 

FIGS. 6 through 9 and FIG. 11 are flowcharts il- 
lustrating procedures of image synthesis in the sec- 
ond embodiment. The image synthesis processing is 
performed by the control of the CPU 10 based on a 
program stored in the ROM 11. 

First, an outline of the image synthesis will be de- 
scribed with reference to FIG. 6. 

First, in order to synthesize the right and left im- 
ages stored in the image synthesis memory 39, a ref- 
erence position for synthesizing the images to the 
center is set, as shown in FIG. 25 (step SO). 

Next, the amount of skew of each of the read im- 
ages is measured (step S1). If the measured amount 
of the skew is within the range "a" shown in FIG. 28 
(for example, between - 0.2 degrees and + 0.2 de- 
grees) in step S2, the process proceeds to step S4 
without correcting the skew. If the amount of the skew 
is outside the range "a", the process proceeds to step 
S3. 

If the measured amount of the skew exceeds the 
range b shown in FIG. 28 (for example, between - 5 
degrees and + 5 degrees), the operator may be noti- 
fied of the abnormality. 

When the amount of the skew is equal to or great- 
er than a predetermined value, the skew of the im- 
ages is corrected in step S3, and the process then 
proceeds to step S4. 

In step S4, in order to synthesize the images, an 
end position of the original is detected. In step S5, the 
image is reconstructed based on the result of the de- 
tection in step S4. 

Since the details of the above-described steps SO 
through S4 are the same as the procedures described 
with reference to FIGS. 7 through 9 in the first em- 
bodiment, a description thereof will be omitted. 

Next, a description will be provided of procedures 
of reconstructing the image shown in the above- 
described step S5 in the second embodiment with ref- 
erence to FIG. 11. 

First, in step S51, as shown in (A) of FIG. 33, the 
images stored in the image synthesis memory 36 are 
moved to the reference position for respective lines 
based on the end position of the original obtained by 
the above-described detection of the end position of 
the original, and the image of the original is recon- 
structed. 

While moving the image, as shown in FIG. 32(A), 



projections and recesses are, in some cases, present 
at the end position of the original although characters 
and figures of the original are not distorted. This is 
caused by errors produced during a reading operation 

5 by the CCD. If image data is moved in this state based 
on the end position of the original, characters and fig- 
ures which are originally not distorted distort, as 
shown in FIG. 32(D). 

Accordingly, as for small projections and recess- 

10 es in imageend data, processing of moving the image 
data based on the position closer to the reference 
position (at the side of projections) (smoothing proc- 
essing) is added. Thus, as shown in FIG. 32(B), the 
image can be reconstructed without producing distor- 
ts tion in characters and figures. 

When smoothing processing of the image has 
been performed, black points and black lines are gen- 
erated in a synthesized portion of the image. Hence, 
in step S52, the bits of the black points and the black 

20 lines generated in the smoothing processing are in- 
verted. Thus, as shown in FIG. 32(C), image synthe- 
sis can be performed without producing distortion in 
characters and figures and without leaving black 
points and black lines in the synthesized portion of 

25 the image. 

Then, in step S54, the region of the original of the 
synthesized image is extracted to provide image 
data. According to this processing, the amount of im- 
age data can be reduced. 

30 According to the above-described procedures, 

the reconstruction of the image of a folded large-size 
original or the image of a cut large-size original is re- 
alized. In the above-described processing, necessary 
temporary data, data of the result of the processing, 

35 and the like are stored in predetermined regions of 
the RAM 12. 

Although a description has been provided of the 
second embodiment of the present invention, the 
present invention is not limited to the above- 

40 described operation of reading left and right regions 
obtained by dividing an image of an original. For ex- 
ample, as shown in FIG. 26, the image of the original 
may be divided into a larger number of regions, and 
images of respective divided regions may be read and 

45 stored in the image synthesis memory 39 while con- 
trolling the read images so as to correspond to each 
other, and the stored images may be synthesized. 

Although in the above-described second em bod h 
ment image synthesis is performed while image data 

so is stored, image synthesis may not be performed 
while image data is stored, but may be performed in 
the graphic RAM 13 when displaying the image data 
during retrieval. 

Although in the above-described second em bod i- 

55 ment the synthesized image is stored in the magne- 
tooptical disk 35, the synthesized image may be 
transmitted to the communication apparatus 38 via 
the communication interface circuit 17 and the conv 



10 



19 EPO 

munication network 37. 

As described above, since an image of an original 
whose size is greater than the reading width of a scan- 
ner can be easily read by dividing the image into a 
plurality of regions, and read images can be synthe- 
sized to reconstruct the Image. Accordingly, it is pos- 
sible to reduce the size and the cost of the apparatus, 
and to remarkably increase the operability of the ap- 
paratus because it is unnecessary to adjust divided 
images of the original by manually moving the original 
in the vertical and horizontal directions. 

The individual components shown in outline or 
designated by blocks in the drawings are all well 
known in the image processing method and appara- 
tus arts and their specific construction and operation 
are not critical to the operation or the best mode for 
carrying out the invention. 

While the present invention has been described 
with respect to what is presently considered to be the 
preferred embodiments, it is to be understood that the 
invention is not limited to the disclosed embodiments. 
To the contrary, the present invention is intended to 
cover various modifications and equivalent arrange- 
ments included within the spirit and scope of the ap- 
pended claims. The scope of the following claims is 
to be accorded the broadest interpretation so as to en- 
compass all such modifications and equivalent struc- 
tures and functions. 



Claims 

1 . An i mage synthesis method usi ng an image read- 
ing apparatus comprising first reading means for 
reading an image on a front surface of an original 
and second reading means for reading an image 
on a back surface of the original, characterized in 
that said method comprises the steps of: 

reading an image on a first surface of a 
folded original and an image on a second surface 
of the folded original by the first reading means 
and the second reading means, respectively, in 
units of a line; 

serially connecting a first image signal 
output from the first reading means and a second 
image signal output from the second reading 
means to each other in units of a line; and 

processing a connected image signal ob- 
tained in said connecting step. 

2. A method according to Claim 1 , further compris- 
ing the step of: 

storing the image signal processed in said 
processing step in a storage medium. 

3. A method according to Claim 1 , further compris- 
ing the steps of: 

storing the image signals output from the 



'6 889 A2 20 

first reading means and the second reading 
means in a memory; and 

correcting skew of the images stored in 
the memory. 

s 

4. A method according to Claim 1, wherein the im- 
age signal is compressed in said processing step. 

5. An image filing apparatus, characterized in that 
10 the images of the original read by said image syn- 
thesis method according to Claim 1 are stored in 
a detachable storage medium. 

6. A method or apparatus for forming a large image, 
15 in which a number of small images are read to 

provide respective image signals for each of the 
small images and the image signals are then syn- 
thesised to provide a composite image signal for 
forming the large image. 

20 

7. A method or apparatus according to claim 6, 
wherein the number of small images are provided 
by folding an original or substrate carrying a large 
image or a number of images. 

25 

8. A method or apparatus according to claim 6, 
wherein the number of small images are provided 
as separate originals or substrates each carrying 
a small image. 

30 

9. A method or apparatus according to claim 6, 7 or 
8, wherein the small images are read simultane- 
ously. 

35 10. A method or apparatus according to claim 6, 7 or 
8, wherein the small images are read sequential- 
ly- 
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